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Summary: 

We  consider  an  exponential  queueing  network  with  different  classes 
of  customers,  under  the  class  of  stationary  service  policies  and  the 
mean  cost  per  unit  time  as  the  loss  function.   It  is  shown  that  the 
queueing  network  can  be  transformed,  without  any  loss  of  generality, 
into  another  queueing  network  in  which  all  the  customers  at  all  the 
service  stations  have  the  same  service  rate.   Stability  properties  of 
the  network  under  the  entire  class  of  service  policies  are  also  derived. 
Moreover,  three  lower  bounds  of  the  loss  function  under  the  whole  class 
of  service  policies,  as  well  as  an  upper  bound  of  the  minimal  loss  are 
derived.   A  convenient  form  of  the  loss  function  is  found,  which  is 
helpful  in  finding  the  form  of  a  good  service  policy.   This  form  is  used 
in  a  separate  paper,  Rosberg  [17],  to  construct  a  practical  method  which 
yields  good  service  policies.   Finally,  applying  the  results  obtained  in 
this  study  to  a  network,  where  the  service  requirements  are  finite  mix- 
tures of  gamma  distributions,  is  discussed. 


1.   INTRODUCTION 

. Queueing  models  consisting  of  a  network  of  service  stations 
and  different  types  of  customer,  moving  from  one  station  to  another, 
receiving  service  at  every  station  are  used  in  many  practical  appli- 
cations.  The  most  common  use  of  queueing  networks  of  the  type  des- 
cribed above  is  in  modeling  computer  systems,  communication  networks 
and  combinations  of  both.   An  extended  review  with  examples  on 
computer  and  communications  systems  modeling  by  a  queueing  network 
is  given  in  Kleinrock  [11].   The  modeling  of  a  Jobshop-like  system 
(see  Jackson  [  7  ])  is  another  practical  use  of  a  network  of  queues. 
These  systems  consist  of  several  departments  through  which  different 
types  of  jobs  move.   These  jobs  must  move  through  several  departments 
before  their  completion.   A  multi-stage  production  line  is  another 
possible  application  of  a  queueing  network.   In  this  application 
different  types  of  parts  of  a  final  product  move  through  several 
machines  and  each  machine  is  capable  of  working  on  several  types  of 
parts. 

An  extensive  use  in  the  last  several  years  of  computer  net- 
works, networks  of  microprocessors  doing  parallel  jobs  as  basic 
components  in  the  new  computer  architecture,  computerized  communica- 
tion networks  and  other  sophisticated  devices  have  renewed  the 
interest  in  queueing  networks.   The  studies  on  queueing  networks  are 
mainly  concerned  with  the  product  form  of  the  stationary  distribution 
of  the  states  of  the  system  under  given  types  of  service  policies  (for 
recent  studies  see  e.g.  Baskett  [  2  ],  Kelly  [ 10] ,  Chandy  [  3  ]  and 
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Noetzel  [15]).   The  insensitivity  phenomenon  in  a  product  form 
queueing  network  relating  to  the  service  requirements  distribution 
has  also  been  studied  (see  e.g.  Barbour  [  1  ],  Schassberger  [18]  and 
Jansen  [  8  ]),  as  has  the  Poisson  processes  arising  from  customers 
streams  in  the  network  (Melamed  [14]). 

The  results  obtained  in  the  studies  mentioned  above  are 
applicable  to  a  quite  restricted  class  of  service  policies.   Practical 
service  policies,  such  as  priority  rules,  are  not  covered  by  the  models 
in  these  studies.   Also,  the  problem  of  finding  an  optimal  or  good 
service  policies  did  not  attain  enough  interest  in  a  queueing  network 
as  in  systems  with  a  single  service  station.   For  systems  with  a  single 
service  station,  optimal  service  policies  have  been  found  under  quite 
general  conditions.   An  optimal  rule,  which  minimizes  the  number  of 
customers  in  the  queue  at  any  moment  of  time  is  given  in  Schrage  [19] 
for  a  G/D/i  queue,  in  which  the  service  duration  of  a  customer  is 
known  upon  arrival.   Optimal  service  policies  in  a  single  service 
queue  with  the  mean  loss  per  unit  of  time  as  the  loss  function,  are 
given  in  Cox  [  5  ],  Kakalik  [9  ]  and  Klimov  [12].   Among  these  works, 
Klimov's  excellent  study  is  done  under  the  most  general  conditions. 
For  total  discount  cost  as  a  loss  function, Harrison  [  6  ]  found  the 
optimal  service  policy  in  a  M/G/1  queue  with  different  classes  of 
customers.   As  to  systems,  with  more  than  one  service  station,  almost 
no  work  has  been  carried  out  yet  for  finding  optimal  or  good  service 
policies. 

In  this  paper  we  shall  be  concerned  with  an  exponential 
queueing  network  with  different  classes  of  customers  under  a  class 
of  stationary  service  policies  and  the  mean  loss  per  unit  time  as  the 
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loss  function  (sections  2.1-2,3).   In  section  2.4  we  shall  show  how 
to  transform  without  any  loss  of  generality  the  queueing  network 
into  a  simpler  one.   Some  stability  properties  Of  the  system  under 
the  entire  class  of  the  service  policies  will  also  be  derived. 
Since  the  problem  of  finding  an  optimal  service  policy  in  a  queueing 
network  is  an  extremely  difficult  problem,  we  are  concerned  in  this 
paper  with  finding  lower  and  upper  bounds  for  the  loss  function 
under  the  whole  class  of  service  policies  (section  3) .   In  section  3 
we  shall  also  express  the  loss  function  in  a  way  which  will  be  help- 
ful in  finding  the  form  of  good  service  policies.   This  expression 
of  the  loss  function  will  be  used  in  a  separate  paper,  Rosberg  [17], 
for  constructing  a  practical  method  of  finding  a  service  policy 
which  reduces  the  loss  function.   The  method  uses  simulation  and  it 
is  programmed  for  an  interactive  computer  use. 

2.   THE  MODEL  AND  PRELIMINARY  RESULTS 

In  this  section  we  shall  present  the  queueing  network  model, 
the  service  policies  and  the  Markov  processes  generated  from  the  model 
under  any  given  service  policy. 

2.1.   DESCRIPTION  OF  THE  MODEL 

We  consider  an  exponential  queueing  network  with  different 
classes  of  customers  and  cost  for  staying  in  the  system,  which  is 
defined  by  the  set  of  parameters 


r  =  (A,B,A,q  (6),iJ^(3),R(e),c^(3)|aeA,3eB)  ,  where 
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A       denotes  a  finite  set  of  service  stations  {l,2,...,a}, 

serving  customers  independently  and  simultaneously. 

Each  service  station  allows  an  unbounded  queue. 
B       is  a  finite  set  {l,2,...,b}  of  classes  of  customers. 
A       is  the  total  arrival  rate  of  customers  from  outside 

the  system  to  all  the  stations.   The  arrival  process  is 

assumed  to  be  Poisson. 
q  (3)    is  the  probability  that  an  arriving  customer  belongs  to 

class  P  and  joins  to  station  a,  aeA,  SeB  and 

I  q^ce)   =  1. 

ct,|3 

P  (ti)    is  the  service  rate  of  customers  of  class  3,i3eB,  when 
a 

they  are  provided  service  at  the  service  station  a, 
cteA.   The  service  requirements  are  exponential  r.v.'s, 
mutually  independent  and  independent  of  the  arrival 
process. 
R(3)    is  a  sub-stochastic  matrix,  which  describes  the  transi- 
tion probabilities  among  the  service  stations  of  a 
customer  of  class  3,  SeB.   The  (a,s)  element  of  R(6), 
denoted  by  r   (3),  oi,seA,  is  the  probability  that  a 
customer  of  class  3,  3eB,  who  has  been  provided 
service  at  station  a,  will  move  next  to  station  s. 
The  probability  that  a  customer  will  leave  the 

system  is  1  -  ^^  r   (3) . 
as 
s 

c  (3)    is  the  cost  of  customers  of  class  3,  3eB,  for  stay- 
ing a  unit  time  at  the  service  station  a,    aeA. 
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To  complete  the  definition  of  the  queueing  system,  we  must  still 
define  the  service  policy,  i.e.,  a  decision  rule  indicating  which 
customer  is  served  at  each  of  the  service  stations  at  any  moment  of 
time.   Let  n  =  (n  (6)  aeA,3eB}  be  the  characterization  at  any  moment 
of  time  of  the  queues  in  system  T,   where  n  (S)  is  the  number  of 
customers  of  class  6  at  service  station  a  at  that  moment.   Further- 
more, let  any  instant  of  time  be  a  potential  decision  epoch.   We 
consider  any  service  policy  which  satisfies  the  following  properties: 
(i)   At  any  moment  of  time  the  decision  rule  is  a  function 

of  the  state  n  only, 
(ii)   The  servers  are  not  allowed  to  be  idle  when  there  are 

customers  at  their  stations, 
(iii)   The  service  of  customers  at  each  service  station  may  be 

interrupted  without  the  loss  of  any  service  duration 

which  has  already  been  provided. 
Any  service  policy  satisfying  (i)-(iii)  can  be  described  by  a  vector 
function  u(n)  =  (u^,u^,...,u  ),  where  u.  e  BUiO)  for  any  ieA,  u.  =  0 
if  and  only  if  n.(ti)  =  0  for  any  lisB  and  u.eB  implies  n.(u.)  >  0. 
(u.  =  0  means  that  server  i  is  idle.) 

2.2.   THE  LOSS  FUNCTION 

In  systems  operating  constantly  through  time,  as  computer 
systems,  the  mean  loss  per  unit  time  is  usually  taken  as  the  loss 
function.   We  shall  give  below  the  form  of  this  loss  function  under 
stationary  conditions.   Let  n  (B)  be  the  number  of  customers  of  class 
3  at  service  station  a  at  time  t.   Also  denote 
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n*^  =  {n^(3)|aeA,eeBi  ,  c  =  ( c^CS)  |  a£A,6eBi  ,  (c,n)  =   ^  c^(&)n^(&)    ,   (2.1) 

a, 3 


X^(t)  = 


fl   n^  =  n  r 

and   X„(T)  =   X„(t)dt 
0   otherwise  ^ 


The  mean  loss  per  unit  time  up  to  time  T  under  any  service  policy  is 

T 


L^  =  E  ^  ZX^(T)(c,n)  =  i  L 


E  x^(t)(c,n)dt  = 


Y   ^  (c,n)P(n''=n)dt  =  ^  f  (c,En^)dt  ",  where 
0  ^  0 

En*^  =  {En'^(e)|cteA,BeB}  . 


Under  stationary  conditions  L_,  — >  L,  where  L  is  the  mean  loss  per 
unit  time  which  becomes 


L  =  (c,n)  ,  (2.2) 

where  n  =  {n  (g)|aeA,6eB}  and  n  (g)  is  the  expected  number  of  customers 
of  class  6  at  service  station  a  under  stationary  conditions  for  a  given 
service  policy.   The  expectation  n  (t3)  might  also  be  infinite  in 
which  case  L  =  °°.   The  loss  L  depends  on  the  service  policy  chosen  and 
the  goal  is  to  minimize  L  by  choosing  the  proper  service  policy.   Find- 
ing an  optimal  service  policy  for  this  model  is  an  extremely  difficult 
problem,  which  is  still  open.   In  this  work  we  find  three  lower  bounds 
for  the  loss  function  and  an  upper  bound  for  the  minimal  loss.   In  a 
separate  paper,  Rosberg  [17],  we  shall  also  give  a  practical  way  of 
finding  a  service  policy  which  reduces  the  loss  function,  as  well  as 
a  heuristic  service  policy  which  is  found  to  work  well  in  some  numerical 
examples.   The  method  is  programmed  to  interactive  computer  use. 
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2.3.   BASIC  ASSUMPTIONS 

We  make  the  following  basic  assumptions  about  the  relative 
traffic  intensity  at  each  service  station. 

ASSUMPTION  2.3.1.  For  any  a,   aeA  and   3,  BeB,  there  exists  an  integer 

k  k 

k  >  1  such  that   1-  T.     r   (g)>0,  where   r   (6)  are   the  elements  of 
—                                           ,   as  as  •' 

seA 

r'^CS),  the   k—  power  of  R(B). 

This  assumption  means  that  any  customer  of  each  class  start- 
ing service  at  any  station  will  leave  the  system  with  positive 
probability,  after  a  finite  number  of  visits  to  the  service  stations. 

For  any  6,  geB,  let  q(6)  =  (q^ (B) .q^ (6) , . . . ,q^(6) )  and 
>^(S)  =  (A  (B),A  (3),...,A  (6)),  BeB  be  a  solution  to 

A(B)(I-R(3))  =  Xq(B)  .  (2.3) 

Under  assumption  2.3.1,  (I-R(6))  is  invertible  for  any  6eB.   (See,  i.e., 
lemma  3  in  Kliraov  [12].)   Together  with  the  nonnegativity  of  R(B)  there 
exists  a  unique  nonnegative  solution  A (3)  to  equation  (2.3). 

00 

From  (2.3)  it  follows  that  A(6)  =  Aq(B)  T.    r'^(B),  e.g., 

k=0 
A  (S),  oceA,  is  the  expected  number  of  potential  visits  of  customers 

of  class  B  to  service  station  a,  arriving  to  the  system  from  outside, 

at  each  unit  of  time.   Let  p  (3)  =  A  (B)/m  (B).   This  expression  is  the 

a       a     a 

potential  relative  traffic  intensity  of  customers  of  class  B  at  service 
station  a  in  the  long  run. 


ASSUMPTION  2.3.2.  For  any  service  station   a,  aeA  Z  o  (3)  <  1. 

BeB  ^ 
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2.4,   EMBEDDED  MARKOV  CHAIN 

Consider  the  stochastic  process 

n^  =  (nSi^)  ,  t  >  0  , 

where  n  is  defined  as  in  (2.1)  and  i  =  {i  laeA}.   Here  i   is  the 

a'  a 

class  of  the  customer  which  is  served  at  station  a  at  time  t.   For 

t  t  t  t 

any  a£A,  i   £  BUiO},  moreover  i   e  B  implies  n  (i  )  >  0  and  i  =  0 

if  and  only  if  n  (fB)  =  0  for  any  geB.   For  def  initeness ,  we  assume 

that  n(0+)  =  0  with  probability  1.   It  is  clear  that  n   is  a  Markov 

process  under  any  given  service  policy  defined  in  section  2.1. 

LEMMA  2.4.1.  Any  system  T  aan  be   transformed  without  any   loss  of 
generality  into  another  system  with  \i    (g)  =  \i. 

Proof.      We  shall  change  the  service  rates,  \i    (g)  and  the  transition 
matrices  R(g),  so  as  to  obtain  the  same  service  rate  for  all  customers 
while  leaving  the  distribution  of  the  process  n   unchanged.   The 

changes  are  done  as  follows.   Let  u  =   max   y  (g) (1-r   (g))  and 

■    ^   T,      Of  eta 

aeA.gcB 

for   any   aeA,    geB  define 


r*    (g)   = 

as 


r^s(6)M^(g)/p  if      s   i'   a    , 

1   -    (1-r      (g))u    (B)/p  if      s   =  a    . 

aa  a 


Now,  let  the  redefined  system  be  V*   =  (A,B,A,q  (g) ,m,R*(6) ,c  (g) | aeA, geB) . 
For  any  given  service  policy,  let  n   and  n*   be  the  Markov  processes 
generated  from  the  same  service  policy  by  the  system  F  and  V*   respectively, 
From  the  exponential  properties  of  the  processes  n   and  n*  ,  it  is  easy 
to  see  that  the  Markov  processes  of  the  pure  jumps  embedded  in  those 
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processes  are  the  same.   Furthermore,  the  processes  of  the  time  lengths 
between  pure  jumps  in  n   and  n*  are  also  the  same.   (A  pure  jump  in 
the  process  n   is  a  transition  accompanied  with  a  change  in  the  state 
of  the  process  and  the  pure  jumps  process  embedded  in  n   is  the  process 
defined  by  n  at  the  moments  of  time  when  pure  jumps  occur.)   (e.g., 
see  Lippman  [13]  or  Cinler  [  4  ],  Chap.  8.)   Thus,  under  any  service 
policy,  n   and  n*   have  the  same  distribution.   This  completes  the  proof. 

From  now  on  we  shall  consider  only  systems  T*   with  p  (8)  =  \i 

a 

for  any  aeA,  6eB  and  shall  omit  the  star  in  our  notation.   In  addition 
to  this  reformulation  we  add  to  each  service  station  one  dummy  customer, 
denoted  by  0,  who  is  served  when  and  only  when,  there  are  no  other 
regular  customers  at  the  service  station.   The  parameters  of  the 
dummy  customers  in  the  system  T   are  c  (0)  =  0,  q  (0)  =  0,  p  (0)  =  u 
and  r   (0)  =  1  for  any  aeA.   Let  B*  =  BU{0},  where  B  is  the  set  of 
classes  of  regular  customers.   The  reformulation  proposed  by  lemma 
2.4.1  and  the  addition  of  dummy  customers  leave  the  probabilistic 
behaviour  of  n   and  the  loss  function  unchanged  while  at  the  same 
time  greatly  simplify  the  analysis. 

We  shall  observe  the  process  n   at  the  moments  of  time  when 
transitions  occur.   (Not  necessarily  caused  by  a  change  in  the  state.) 
A  transition  occurs  if  either  one  of  the  following  occurs: 
(i)   A  new  customer  from  outside  arrives  at  one  of  the  service 
station, 
(ii)   One  of  the  customers,  possibly  the  dummy  one,  finishes 

being  served  at  one  of  the  service  stations.   (The  customer 
might  immediately  return  to  the  same  station  in  which  case 
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Let  N,  N  =  1,2,3,...  denote  the  sequence  of  transitions  and  let  the 

i~  H 

time  period  between  the  N-1  and  the  N  transitions  be  called  the  N — 

N 
step.   For  any  acA,  BeB  let  n  (3)  be  the  number  of  customers  of 

class  3  at  station  a  immediately  after   the  N —  transition  has  occurred 

and  let  n  =  {n  (6)  aeA,  6eB}.   Also,  let  i'  denote  the  class  of  the 

a        '  a 

customer  provided  service  at   station  a  irrmediateZy  before   the  N — 

transition  occurs  and  let  i'  =  {i  laeA}.   To  be  consistent  with  the 

a. ' 

}^ 
description  of  a  service  policy  in  section  2.1  let  u(n'  )  =  (u  ,u„,...,u  ) 

X   *-      a 

be  the  vector  of  classes  of  customers  which  are  provided  service  at 

each  station  irrmediateZy  after   the  N —  transition  has  occurred, 

N     N  N 
The  process     n   =  (n  , i  ) ,  N  =  1, 2,  . .  .  is  an  embedded 

Markov  chain  in  the  process  n  ,  t  >_  0,  having  a  denumerable  number 

M 
of  states.   The  stationary  distribution  of  n   (if  it  exists)  is  the 

t  t  N 

same  as  of  n  ,  since  all  the  pure  jumps  of  n   are  covered  by  n 

N 
and  the  lengths  of  time  between  any  two  transitions  in  n   are  equally 

distributed.   Therefore,  it  is  sufficient  to  analyze  the  embedded 

Markov  chain  n  . 

LEI-IMA  2.4.2.  For  any  given  state  of  the  Markov  chain  n     under  any 
given  service  poZicy^    the  probability  that  the  next  transition  uiZZ 
occur  due  to 

(a)  the  corrrpZetion  of  service  by  a  customer   (incZuding  a  dummy  one) 
at  the  service  station   a,  is   \i/h,   for  any   aeA. 

(b)  an  arrivaZ  of  a  customer  of  cZass   S  to  station  a  from  outside, 
is   Xq^(B)/A,  for  any   aeA,  peB,  where   A  =  A  +  ay. 
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Pvoof.      The  lemma  follows  immediately  from  the  fact  that  the  service 
requirements  and  the  interarrival  lengths  of  time  between  two  customers 
are  exponentially  distributed.   This  follows  by  direct  computation  of 
the  probabilities  in  which  the  reformulation  of  F  is  crucial. 

For  any  asA,  let  S„  =  {n|n  (S)  =  0  for  any  BeB}.   Whenever 

n  e  S„,  there  is  only  a  dummy  customer  at  station  a.   Also,  let  t 

ct 
denote  the  first  re-entry  time  to  S„  and  E/   •\('i^^)  the  expectation 

^  0      (n,i)  0.  ^ 

of  T  ,  given  that  n  =  (n,i). 

LEMMA  2.4.3.  UndsT  assumptions  2.3.1  and  2.3.2,    the  Markov  chain 
vt  ,   N  =  1,2,...,  under  any  service  policy ,    is  irreducible,  aperiodic 
and  satisfies  the  following  properties: 


(a)  For  any   a,    aeA  and  state  (n,i),  E,   . ,  (t  )  <  B  (n)  <  °°, 

•^  (n,i)   a  —  a       ' 

where   B  (n)  is  a  number  independent  of  the  service  policy. 

(b)  For  any  a,   aeA  and  state    (n,i) 

,   N     . 
lim  inf  i  Z   P(n^  t   Sq/h^  =  (n,i))  1  1  -  S   P  (6)  >  0  . 
N^   '  j=l  aeB 

Proof.      The  irreducibility  and  aperiodicity  are  easily  checked  from 

N 
the  transition  probabilities  of  n  .   Part  (a)  of  the  lemma  is  proved 

in  Rosberg  [16],  section  3,  and  the  bounds  B  (n)  are  given  explicitly, 

The  proof  of  part  (b)  follows  along  the  same  lines  as  the  proof  of 

theorem  2  in  Rosberg  [16]  using  the  results  given  in  section  3  there. 


REMARKS 
(i)   The  bounds  B  (n) ,  which  are  explicitlv  given  in  Rosberg  [16],  are 
easily  computed  and  may  be  used  in  practice  for  evaluating 
the  performance  of  a  networks  of  queues  under  any  service 
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policy.   As  an  example,  B  (0)  =  1/(1  -  Z   p  (6)),  where  0 

^  BeB  °' 

stands  for  the  zero  matrix. 

(ii)   Part  (b)  of  lemma  2.4.3  means  that  the  long  run  proportion 

of  time  that  any  service  station  a,    cteA,  stays  empty  is 

positive.   That  is,  under  assumptions  2.3.1  and  2.3.2, 

the  network  under  any  service  policy,  is  not  overloaded 

and  the  number  of  customers  at  each  service  station  does 

not  explode  to  infinity.   This  property  is  weaker  than 

egrodicity  and  ensures  the  stability  of  the  network. 

N 
(iii)  Assumptions  2.3.1  and  2.3.2  are  sufficient  for  n   to 

be  ergodic  under  certain  service  policies  (for  example 
the  Serive-Sharing  policy),  but  it  is  still  an  open  ques- 
tion whether  these  assumptions  are  sufficient  for 
ergodicity  under  an  arbitrary  service  policy. 

In  the  analysis  in  the  next  section  we  shall  consider  only 

N 
service  policies  under  which  n   is  ergodic  and  the  loss  function  L 

is  finite.   Other  service  policies  are  not  of  interest  since  they 

provide  an  infinite  loss. 

3.   BOUNDS  OF  THE  LOSS  FUNCTION 

In  this  section  we  shall  represent  the  loss  function,  L,  by 
a  sum  of  two  expressions.   The  first  expression,  which  is  independent 
of  the  service  policy,  is  used  as  a  lower  bound  for  L.   The  second  one 
is  used  to  construct  a  subclass  of  service  policies  which  reduce  the 
loss  toward  the  lower  bound.   This  representation  is  derived  by 
using  the  technique  used  in  Klimov  [12]  for  a  single  server  station. 
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In  addition  we  find  two  other  lower  bounds  and  one  upper  bound.   These 
bounds  are  used  to  evaluate  the  service  policies  in  the  class 
suggested  above. 

3.1.   THE  PROCESS  n^ 

N 
Let  n  be  a  Markov  chain  generated  by  V   and  any  given 

service  policy.   For  any  set  n  =  {n  (B)|aEA,  6eB*}  and  any  set 

Z  =  {Z  (3)iaeA,  geB*}  of  numbers  Z  (6),  let 
a    '  a 

n  (6) 
Z"  =   n  Z  (6)  " 
aeA 
BeB* 

I  N     Ni 

Further,  for  any  set  g  =  (3   aeA,  6  eB*}  and  anv  set  i  =  {i  aeA}, 

—     a'      a  '  a' 

let 


—      aeA   a'  a 

where  5_   .N  is  the  Kronecker  delta.   We  shall  write  0  <  Z  <  1  iff 

p  ,  1  —   — 

a'  a 

0  <  Z  (B)  <  1  for  all  aeA,  3eB*  and  Z  =  1  if  Z  (g)  =  1  for  all 

—  a    —  a 

aeA,  geB*.   For  0  <_  Z  <_  1  and  any  8_,  let 

P3,n(^)  =  E(z"^^,iN)  ;  Rg^^CZ)  =  ECzA^^^^^N^) 

N 
Pj^(Z)  =  E(Z"  )  . 

We  have,  P^(Z)  =  E  F^^^iZ)    =  Z  R^^^CZ). 

-  ~        ^  "      ,N  „ 

For  Z  (3)  =  0  let  R„  „(Z)/Z  (3)  =  E(z"   5,  .N),  where  n''  is  derived 
a  3_,N     a  3_,  1 

N 
from  n  by  removing  one  castomer  of  type  3  from  station  a. 
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LEMMA  3.1.1.  For  any  possible   _§_  we  have 


^,N+l(^)  =  \ 
— '         aeA 


a  a 


—       aeA 
SeB 


where 


Q  "(Z)  =  E  (r   (6  )Z  (6  ))  +  (l  -   E  r   (B  )]  . 

a         .  ^  as   a   s   a  ^    ^       .  as   a  -^ 
St A  seA 

Fvooj.      For  any  azk,    BeB*  interpret  the  number  Z  (6)  as  the  probability 
that  a  customer  of  class  3  entering  service  station  a  (after  some 
service  in  any  service  station  or  upon  entering  the  system) ,  is 

"colored  by  red"  and  1  -  Z  (6)  as  the  probability  that  he  is 

a 

"colored  by  blue."   Thus,  customers  may  change  their  colors  after 
any  demand  for  service.   The  color  assignments  are  mutually  inde- 
pendent and  independent  of  the  service  requirements  and  the  arrival 
process.   Now,  with  this  probabilistic  interpretation  we  have  the 
following: 

Pfl  M_Li  (Z)  is  the  probability  that  at  the  N+1  step 
_p_,  iN+i 

a  customer  of  class  B  was  served  at  station  a,  for 

a  ' 

all  aeA  and  after  this  step  was  completed  no  blue 

customer  remained  in  the  system. 

R  „(Z)  is  the  probability  that  after  N  steps  are 

completed,  all  the  remaining  customers  are  red  and 

at  the  next  step  a  customer  of  class  3   is  served 

a 

at  station  a,  for  all  aeA. 

R  j^(Z)/Z^(B^)  is  the  probability  that  after  N 
steps  are  completed,  all  the  remaining  customers 
are  red  excluding  possibly  the  customer  which  will 
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the  next  step  a  customer  of  class  3.  is  served  at 

1 

station  i  for  all  ieA. 

q  (3)Z  (3)  is  the  probability  that  an  arriving 

customer  belongs  to  class  3,  joins  to  station  a 

and  is  colored  by  red. 

Q   (Z)  is  the  probability  that  a  customer  of 

class  3   which  has  been  served  at  station  a 

a 

does  not  become  blue  after  being  served. 

The  lemma  now  follows  from  the  probabilistic  interpretations 
above  and  from  lemma  2.4.2. 


LEMMA  3.1.2.  The  following   limits  exist 


N-HX)    — '  — 


N-H"    — '  — 


lim  P-,(Z)  =  P(Z)  . 


In  addition. 


P  (Z)  =  z 

^      aeA 


R.(Z) 


tQ"(z) 


Z  (3  )  A  ^a 


+R  (Z)  \     I      q^(S)Z^(6)  , 
—      aeA 
6eB 


(3.1) 


and  under  any  service  policy 


lim  P(iJJ  =  3)  =  E  R«(l)<5„   .  =  L   P«(l)6„   ,  =  p^(3)  for  any  aeA,  3eB  , 


(3.2) 


lim  P(i^  =  0)  =  Z  Rn(l)5-   _  =  Z  Po(l)6p    =1-1  p  (3)  >  0  for  any  cteA  . 
Froof.      From  lemma  2.4.3,  n'  is  irreducible  and  aperiodic  and  from  our 


assumption  it  is  also  ergodic.   Thus,  all  the  limits  in  the  lemma  exist 
and  (3.1)  follows  directly  from  lemma  3.1.1.   For  any  ieA  and  jcB*  let, 


and,  for  any  possible  B_,  let, 
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^  rr  P(Z)L  ,  ^     (3.3) 


X.  .(3)  =  -^t-Vt  Rft(Z)l7_T  .  (3.4) 

i,J  -     <5Z  (j)   £    'Z=l 


From  the  definitions  of  P(Z)  and  R2(Z),  it  follows  that 


X    =  S  X.  .(6)  .  (3.5) 

-^ »  J    a   -^  » J 

From  (3.1)  and  the  definitions  of  P(Z)  and  Ro(Z)  we  have 

6 
P(Z)  =  Z   P  (Z)  =  Z  Rg(Z){^  Z   q^(S)Z^(6)  +f  E  Q^""  (Z) /Z^(6^) }  .  (3.6) 

Taking  the  partial  derivatives  with  respect  to  Z . ( j ) ,  isA,  jeB,  on  the 
left  and  the  right  hands  of  (3.6)  at  the  point  Z  =  1,  we  obtain  from 
the  definitions  in  (3.3)  and  (3.4),  that  for  any  ieA  and  jeB 

From  ergodicitv  it  follows  that  E  Rq (1)  =  1.   Thus,  from  (3.5)  and 

6   ^ 
(3.7)  we  obtain  that  for  any  ieA  and  jeB 


Z  yRo(l)5.   .  =  \q.(j)  +  Z   r^  ,(j)  Z  pR«(l)5s  ,  .     (3.8) 

For  any  aeA  and  BeB  let  y  (g)  =  lim  P(i^  =  6).   Hence,  y  (g)  =  Z  R^(l)6 

NHM30  g^  —     a 

Using  this  expression  for  y  (6)  in  equation  (3.8)  we  have,  for  any 

aeA  and  BeB  , 


U  y  (S)  =  A  q  (S)  +  Z  r   (6)uy  (S)  .  (3.9) 

a  J.  .  s ,  a     s 

seA 
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From  section  2.3  and  assumptions  2.3.1  and  2.3.2  we  have 

y  (S)  =  P  (6)  ,  for  any  aeA,  SeB     _         (3.10) 

and  from  ergodicity, 

y  (0)  =  1  -  Z     p  (e)  >  0  for  any  aeA  .  (3.11) 

**         BeB  ^ 

From  (3.1)  it  follows  that 

R„(l)  =  P,(l)   for  any  possible  6  .  (3.12) 

Equations  (3.10)-(3.12)  complete  the  proof. 

One  may  define  a  loss  function  L',  as  the  mean  loss  per 
unit  time  arising  only  from  the  waiting  time  of  the  customers  (i.e., 
excluding  the  losses  due  to  time  being  served).   In  the  same  way  as 
used  in  section  2.2  we  obtain  that  L'  =  (c,l),   where  I  =    {i    (S)|cieA,  6eB} 

and  £  (S)  is  the  expected  number  of  customers  of  class  6  in  the  queue 

a 

of  station  a  (excluding  the  one  who  is  possibly  being  served).   From 
(3.2),  it  is  easy  to  see  that  under  any  service  policy 


n^(6)  =  ii^(e)  +  P^(e)  ,  thus 

L  =  L'  +  Z     c  (6)p  (6)  .  (3.13) 

a, 6 

From  (3.13)  we  obtain  the  following  corollary. 


COROLLARY  3.1.1.   The  preference  order  among  the  service  policies  is 
the  same  under  the  loss  functions  L  and  L' ,  where  the  preference  order 
is  defined  according  to  the  values  of  the  loss  functions  under  the 
set  of  service  policies. 
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3.2.   A  LINEAR  PROGRAMMING  PROBLEM 

The  problem  of  finding  a  service  policy  which  minimizes  the 
loss  function  is  a  dynamic  programming  problem  with  a  denumerable 
state  space.  We  shall  transform  this  problem  into  a  linear  programming 
problem  with  a  finite  number  of  variables.  The  linear  programming 
problem  will  have  a  larger  space  of  feasible  solutions  than  the  space 
of  feasible  service  policies.  For  any  i.keA  and  j,meB*  let 

y   (k,m)  =  y   X   (3)5     . 
^»J        g   ijj  —  Sj^,m 

The  variable  y.  .(k,m),  i,k£A,  j,m£B*,  is  the  expected  number  of 
customers  of  class  j  at  station  i,  under  stationary  conditions,  given 
that  a  customer  of  class  m  is  provided  service  at  station  k,  times 
the  probability  that  a  customer  of  class  m  is  provided  service  at 
station  k.   The  variables  y.  . (k,m)  are  closely  related  to  the  service 
policies  and  are  convenient  for  optimization  purpose. 

LEMMA  3.2.1.  For  any  Markov  jhain  vt  ,   i,keA  c:nd   j  ,meB*  we  have 


•^  aeA         '-^        aeA 

+  -  q  (m)  Z   y    (i.S)  +  ^   q  ( j )  Z   y   „(k,S)  +  t(i,j,k,m)  , 


(3.14) 


wneve 


2P  .  (j)(l-r.  .  (j))  if   i=k  and  j=m  , 


IX 


t(i,j,k,m)  =<  -  (p,(m)r.  ,  (m)  +  a,  (m)r,  .  (m) )   if   i=|=k  and  j=m  ,   (3.15) 
1  0  otherwise  . 
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Pvoof.      The  lemma  follows  by  equating  the  partial  derivatives  of  both 

sides  of  formula  (3.6)  with  respect  to  Z . ( j )  and  Z  (m)  at  the  point 

i         k. 

Z  =  1.   Indeed, 


R.(Z) 

9     ^ 


3Zi(j)  Z^(B,) 


Z=l  =  ^,j(^>  ' 


=  X.  .(6)  -  Rn(l)<5,.  ..     ,      „  .  , 
2=1    I'J  -     i    (i,j).(c,8^) 


Ro(Z) 


9Z.(j)3Zj^(m)  Z^(6^)  ^^^ 


Ro(z) 


-  X.  .(6)6 


SZ,(j)3Z,  (m)  £    '    1=1  i,j  -   (a, 6  ),(k,m) 


^k,m^^)^a,B^),(i,j)  ^  2^6^^^^a,B^),(i.j)^a,B^),(k,m)  ' 


3Z.(j) 


Z  q^(6)Z^(6) 

a, 6 


Z=l 


=  Xq,(J)  , 


3Z.(j)3Zj^(m) 


a,6 


=  0  , 


Z=l 


'rrQ'cz) 


3Z.(j)  ^a 


Z=l  =  '^a,i^^>^  ,j  ' 
a 


3Z.(j)3Z  (m)  'a 

1         iC 


qJ^z) 


z=i 


=  0 


3Z.(j)3Zj^(m) 


P(Z) 


Z=l    3Z.  (j)9Z,  (m) 
1  -^    k 


2  Ro(Z) 


=  Z 


Z=l   6  3Zi(J)9\(-)   6 


Ro(z) 


z=i 


In  addition,  from  the  definition  of  y.  . (k,m)  we  have  for  any  ieA  and 


y.  ,(i,o)  =  0  , 
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and 


X.  .  =   I   y.  .(i,3)  =   E   y.  . (i,3)  . 
^'^    SeB*   ^'^        BgB   ^'^ 

Now,  Che  lemma  follows  by  direct  computation  from  (3.6)  and  the  above 

formulas . 


From  the  definitions  of  x  .  and  y   ^(k,m)  it  follows  for 

a, 3      a, 3 

any  aeA  and  3eB, 


n  (S)  =  X   ,  =  Z       V   ,(k,m)  ,  for  any  keA        (3.16) 
^'^   msB*'^'^ 

and 


y^    ft^^'°)  =      ^      Vr.    ft(ci,m)  -   Z   y   ,(k,m)  ,  for  any  keA  .     (3.17) 
meB  meB    ' 

From  (2.2)  and  (3.16)  we  have, 

L  =  -  Z   c  (3)   E   V   .(k,m)  .  (3.18) 

^  a, 3  ^    keA  '°''^ 
meB* 

The  variables  y   -(k,m),  a,k£A,  3, meB*  must  satisfy  the  inequalities 

ct ,  3 

(among  possibly  other  constraints). 


y   3(k,m)  >  0  for  any  a, keA,  3, meB*  ,  (3.19) 

ct ,  p      — 

and  the  equations  (3.14)  and  (3.17).   Minimizing  L,  given  in  (3.18), 
subject  to  the  linear  constraints  (3.14),  (3.17)  and  (3.19)  is  a 
finite  linear  programming  problem. 

To  simplify  the  problem,  we  shall  represent  it  in  a  matrix 
form  which  has  a  special  structure.   Define  the  matrices  Y  =  (y(i,j)) 
and  T  =  (t(i,j)),  the  column  vectors  q  =  (q(i))  and  c  =  (c(i))  as 
follows: 
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y.     .  (k,m)      if      l_<i,kj<a   and   lj<j  ,m<^b    , 

y((in-l)a+k,(j-l)a+i))    =}   y.     .(k,0)      if      l£i,k<_a;l£Jlb   and  m=b+l    , 

i      ^'J 

0  if   l£i ,  k£a  ;  l£m<^b+l  and  j=b+l  . 

The  element  y ( (m-l)a+k, (j-l)a+i)  is  the  element  of  the  (m-l)a+k  row 
and  the  (j-l)a+i  column.   The  matrix  Y  so  defined  has  (b+l)a  rows 
and  columns. 

t(i,j,k,m)   if   lj<i,k_<a  and  l<_j  ,m_<b  , 
t((j-l)a+i,  (m-l)a+k)  =  <|  0  if   1  <_i , k^a ;  1  <^j ^b  and  m=b+l  , 

0  if   l£i,k£a;l£m<^b+l  and  j=b+l  , 

where  t(i,j,k,m)  are  the  elements  defined  in  (3.15).  The  element 
t((j-l)a+i5  (m-l)a+k)  is  the  element  of  the  (j-l)a+i  row  and  the 
(m-l)a+k  column.   The  matrix  T,  so  defined  has  (b+l)a  rows  and  columns. 


r 


c((m-l)a+k)  =\ 


I  c,  (m)   if   1  £  k  <_  a  and  1  <_  m  _<  b  , 


Lc 


if   1  <  k  <  a  and  m  =  b  +  1 


q((m-l)a+k)  = 


q,  (m)   if   1  ^  k  <_  a  and  1  <_  in  <_  b  , 


Lo 


if   1  <  k  <  a  and  m  =  b  +  1 


Also,  define  the  matrix 


R  = 


R(l)        0 
R(2) 


0 


R(b) 


!_ 


where  I  is  the  identity  matrix  of  rank  a.   Let  \_=    (1,1,..., 1)'  be 
a  (b+l)a  element  column  vector,  all  whose  elements  are  one. 
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Using  the  notations  above  we  have  that  L  =  (c,Y'l^)/a.   Now 

minimizing  L  is  the  same  as  minimizing  (c,Y']^).   Thus,  the  linear 

programming  problem  given  in  (3.14),  (3.17),  (3.18)  and  (3.19) 
becomes 


min  (c,Y']^)  ,  (3.20) 

Y 


where  the  element  Y=  (y(i,j))  satisfy 


Y  >  0 


and  (3.21) 

Y  +  Y'  =  Y'R  +  R'Y  +  —  Y'lq'  +  —  ql'Y  +  T  , 

ay   —     ay  ^ 

where  X'  is  the  transpose  of  the  matrix  X. 

REMARK  3.2.1. 
(i)   Any  feasible  service  policy  corresponds  to  a  matrix  Y  satisfy- 
ing the  set  of  constraints  (3.21),  but  not  vise  versa.   This 
is  clear  from  the  way  we  constructed  the  linear  programming 
problem.   Hence,  solving  the  linear  programming  problem  (3.20)- 
(3.21),  does  not  yet  provide  the  optimal  service  policy. 

(ii)   The  set  of  constraints  (3.21)  does  not  include  the  constraints 
given  in  (3.17)  in  their  full  strength.   The  reason  is  that  we 
want  to  obtain  the  convenient  structure  of  the  constraints 
as  given  in  (3.21).   The  constraints  in  (3.17)  will  be  used 
later  to  obtain  a  better  lower  bound  for  L. 
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3.3.   ANOTHER  FORM  OF  THE  LOSS  FUNCTION  L 

We  use  the  special  structure  of  the  linear  programming 
problem  given  in  (3.20)  and  (3.21)  to  obtain  a  form  of  the  loss  function, 
for  which  the  constraints  are  already  built-in.   The  loss  function  so 
obtained,  provide  a  lower  bound  for  L  and  gives  an  idea  how  to  con- 
struct good  service  policies. 

Since  the  algebraic  structure  of  our  linear  programming 
problem  has  the  same  algebraic  structure  as  the  linear  programming 
problem  in  Klimov  [12],  sections  9,  10  (but  representing  a  completely 
different  problem) ,  we  shall  use  the  notation  and  the  results  appear- 
ing there. 

Let  Q   =  {1, 2, . . . , (b+l)a}  be  a  set  of  phases  of  service. 
For  any  i,  l_^i^a  and  j>l£^j^b,  the  element  (j-l)a+i  in  Q   corresponds 
to  a  phase  of  service  of  a  customer  of  class  j  at  station  i.   The 
element  ba+i  corresponds  to  a  phase  of  service  of  a  dummy  customer 
at  station  i.   Note  that,  any  phase  pefi,  determined  uniquely  the 
class  of  the  customer  and  the  service  station.   We  shall  define  a 
complete  order,  henceforth  "Klimov  order,"  among  the  phases  of  service 
in  il,    as  following. 

Let  Y  =  (y-|  ,  Y-j, .  . .  ,Y /,  , -■  N  )'  denote  a  column  vector  and  let 
M  be  any  subset  of  il.      Denote  by  y  (M)  the  vector  obtained  from  Y 
after  removing  the  elements  y-,  for  all  ieiAM.   Further,  let  R(M)  be 
the  matrix  obtained  from  R  after  removing  all  the  columns  and  rows 
with  indexes  in  i^\M. 
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Since  (I-R(3))  is  invertible  for  every  6£B,  so  is  (I-R) . 

Thus,  for  any  >ti^ ,  (I(M)-R(M))  is  invertible,  where  I (M)  is  the 
identity  matrix  of  order  //M. 

Let  Y (M)  =  (y.(M)),  tti^,  be  the  solution  of  the  equation 

(KM)  -  R(M))y(M)  =  KM)  ,  (3.22) 

where  1(M)  =  (1,1,..., 1)'  is  a  column  vector  of  order  #M. 

The  element  y • (M) ,  IeM  of  the  vector  Y (M) »  is  the  mean 
total  number  of  visits  to  phases  of  service  in  M,  of  a  customer 
starting  with  phase  i  ap  to  its  first  exit  from  M. 

Define  a  sequence  of  phases,  p  ,,.,..., p„,p   by  the 
following  recursive  relations: 


\(b+l)  =  "  '   S^^^(b+1)^  =  "'^^^      ^°''  ^""^      ^^^    ' 


c   (M.)  .„  , 

Pi  ^D^   ±^ 

=min  —2 =  m  d  eM   • 

Y   (M.)   peM.  Y  (M.)     i  '   ^i   i  ' 

p .   1    ^   1  p^  1 


(3.23) 


^i-1  =  ^i^^Pi^ 


c  (M.  ,)  =  Y  (M.) 
p   1-1      p   1 


Yp(M.)  -  '"i 


>_  0  ,   for  any  peM._ 


REMARK  3.3.1. 


(i)   It  is  clear  that  the  ordered  sequence  p  ,,,,..., p^,p   need  not 
be  uniquely  determined  since  ra.  in  (3.23)  may  be  attained  for 
several  phases.   Any  order  of  the  sequence  is  suitable. 
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(ii)   The  set  of  phases  {p,  ,-\^l?-l.^^    can  be  obtained  by  the  procedure 
given  in  (3.23),  in  any  order  among  themself  and  will  always 
correspond  to  the  phases  of  service  of  a  dummy  customer  at 
station  i,  for  all  isA.   For  convenience  of  the  notation  we 
shall  choose  the  order  such  that  phase  p     ,  ieA,  correspond 
to  the  phase  of  service  of  a  dummy  customer  in  station  i. 

DEFINITION  3.3.1.  For  any   i,jen,  the  phase   p.  precedes 
phase   p. (p.  <   p.)  aaaording  to   the   "Klimov  order"  if±<j. 

Now,  rename  the  set  of  phases  Q  =  {p   p  ,...,p,,   .  }  such 
that,  phase  p.eQ  will  be  denoted  by  i.   Note  that  under  this  renaming, 
for  any  p,p'£Q,  p-<p'  if  and  only  if  p  <  p'. 

With  this  new  notation  we  shall  change  the  elements  in 
Y,  R,  T,  q  and  c  accordingly.   For  any  ie\l,    let  the  i —  row  of 
Y,  R,  T,  q  and  c  be  replaced  by  its  p.—  row  and  similarly  for  the  columns 
of  Y,  R  and  T. 

Henceforth  the  notations  ^=  {1, 2, . . . , (b+l)a} ,  Y,  R,  T,  q 
and  c  will  be  used  to  denote  the  appropriate  reordered  phases, 
matrices  and  vectors.   It  is  clear  that  the  problem  and  the  results 
obtained  so  far  are  not  affected  by  this  renaming. 

For  any  p,  l<^pj<(b+l)a,  let  M  ,  Y .  (M  ),  c .  (M  ),  i<_p,  be  the 
elements  obtained  by  the  procedure  given  in  (3.23).   For  any  p, 
l_^p^ba,  define  the  following  vectors,  each  with  (b+l)a  elements: 

Up  =  (Yi(Mp),Y2(Mp),...,Yp(Mp),0,...,0)' 
and  (3.24) 

Vp  =  (0,0, ... ,0,1,1,. ..,1)'  , 


(3.25) 
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where  v  has  p  zeros  preceding  the  one's. 
Further,  let 

z  =  c  (M  )/y  (M  )  , 
P    P  P   P  P 

hp  =  (Vp,YUp)/(l-A(q,Up)/ay)  , 
gp  =  (TUp,Up)/2(l-X(q,Up)/ay)  , 
2  =  (z^,Z2, .  . .  ,z^j^) '  ,   h  =  (h^,h2,  .  . .  ,h^^) ' 

and  g  =    (g^,g2,..  "§3^^'    * 

THEOREM  3.3.1.      Under  any  sewi-oe  ■poliay 

L  =  (z,g)/a  +  (z,h)/a  . 
In  addition^    z>_0  and   h>_0. 
Proof.      From  (3.18)  we  have 

L  =  (c,Y'l)/a  .  (3.26) 

The  linear  prograimning  problem  in  (3.20)  and  (3.21)  has  the 
same  algebraic  structure  as  the  linear  programming  problem  in  Klimov  [12], 
section  9.   Following  the  same  procedure  as  in  Klimov  [12], 
sections  9,  10,  we  obtain  the  theorem  from  (3.26)  and  the  definitions 
given  in  (3.24)  and  (3.25). 

REMARK  3.3.2. 

Theorem  3.3.1  gives  a  representation  of  L,  as  a  sum  of  two 
expressions.   The  first  one  is  independent  of  the  service  policy  and 
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is  used  as  a  lower  bound  of  L.   The  second  one  is  dependent  on  the 
service  policy  through  Y  and  is  used  in  a  separate  paper,  Rosberg  [17], 
for  constructing  service  policies  which  reduce  the  loss  function. 

3.4.   BOUNDS  OF  THE  LOSS  FUNCTION 

The  theorems  below  contain  three  lower  bounds  of  the  loss 
function,  none  of  which  is  an  infimum.  Also,  an  upper  bound  of  the 
minimum  loss  is  derived.  The  bounds  have  importance  for  evaluation 
of  systems  T   and  service  policies. 

THEOREM  3.4.1.  Under  any  service  poliay 

L  >_  (z,g)/a  4  LBl  . 

Proof.      The  theorem  follows  directly  from  theorem  3.3.1  and  remark 
3.3.2. 

REMARK  3.4.1. 

From  the  definitions  in  (3.24)  and  (3.25)  it  can  be  shown 

(see  Rosberg  [17])  that 

ab  a(b+l) 
(z,h)  =   Z      Z    w(p,p')y(p,p')  ,  (3.27) 

p'=l  p=p'+l 

where,  w(p,p')  are  nonnegative  constants  independent  of  the  service 

policy,  y(p,p')  are  the  elements  of  Y,  whose  rows  and  columns  are 

ordered  according  to  "Klimov  order." 

By  recalling  the  Form  of  the  linear  programming  problem 

(3.20)  and  (3.21),  it  also  can  be  shown  that,  there  exists  a  matrix 

Y  such  that  y(p,p')  =  0  for  any  p',  lj<p'<^ab  and  p,p '+lj<p<a(b+l) 
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which  also  satisfies  (3.21).   Thus,  from  theorem  3.3.1  and  (3.27)  it 
follows  that  LBl  is  the  best  lower  bound  which  can  be  derived  from 
the  -linear  programming  problem  (3.20)-(3 . 21) .   Note  that  LBl  can  be 
computed  without  solving  the  linear  programming  problem. 

From  remark  3.2.1  (ii)  it  is  clear  that  we  can  obtain  a 
better  lower  bound  than  LBl,  by  solving  the  linear  programming  problem 
(3. 20)-(3.21)  with  the  additional  constraints  given  in  (3.17).   In 
this  case  we  cannot  find  the  minimum  value  of  the  objective  function 
given  in  (3.20),  without  solving  the  linear  programming  problem. 
Let  V„  be  the  minimum  value  of  the  objective  function  given  in  (3.20) 
under  the  constraints  (3.21)  and  (3.17).   The  value  V„  can  be  obtained 
by  the  simplex  method  using  available  computer  programs. 

Let, 

LB2  A  Vg/a  . 

Recalling  the  origin  of  the  linear  programming  problem  given  by  (3.20), 
(3.21)  and  (3.17)  we  have  from  (3.26)  the  following  theorem. 

THEOREM  3.4.2.  Under  any  service  policy 

L  ^  LB2  . 

The  following  lemma  follows  directlv  from  results  appearing 
in  several  papers.   (See,  e.g.,  Baskett  [  2  ].) 

LEMMA  3.4.1.  Under  the  service- sharing  service  policy,    the  stationary 
distribution  of   n  ,  t>_0  is 
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P(n)  =  n 


(1  -   S   P  (B)) 


n^(l)+n^(2)+,...,+n^(b) 


n^(l),n^(2),....,  n^(b) 


n  p  (B) 


n,(B) 


where   n  =  {n  (B)  aeA.BeB}, 


The  lemma  will  be  used  below,  to  derive  another  lower  bound 
and  an  upper  bound  of  the  loss  function. 


THEOREM  3.4.3.  Under  any  service  'policy 


L^  E   (min  c^(B))  T.      p^(B)  /  (l-P^(B) )  A  LB3  . 
BeB   ieA        aeA 

Proof,      For  any  B^eB,  consider  the  reduced  systems  r„  obtained  from 

r,  consisting  of  customers  of  class  B^  only.   (i.e.,  B  =  (B^l.) 


0 


0-' 


-0 


Let  n  i^rs)    be  the  expected  number  of  customers  of  class  6„ 
a   ')  0 

at  station  a,  under  stationary  conditions,  in  the  system  V      . 

It  is  clear  that  for  any  Bp,eB  and  under  any  given  service 
policy  in  the  system  F, 


aeA         aeA 


(3.28) 


where  n  i^^,)    is  the  expected  number  of  customers  of  class  B^,  at  station 

a   U  (J 

a  under  stationary  conditions  and  under  a  given  service  policy  in  the 
original  system  r. 

The  values  n  (B^^),  are  independent  of  the  service  policy 


a^  0 


,0 


taken  in  system  V^    .   Thus,  it  follows  from  lemma  3.4,1,  when 
B  =  {Bq},  that 


aeA  aeA 


(3.29) 
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From  (2.2),  (3.28)  and  (3.29)  we  have 

L  =  X  c^(B)n^(S)  >   Z  (min  c.(6))  Z  n^(e)  ^  i:  (min  c.(e))  Z  p^(6)  /  (l-p^(g) ) 
aeA  BeB  IeA       aeA        BeB  ieA       aeA 

BeB 

REMARK  3.4.2. 

We  have  LB2  >^  LBl.   However,  LB3  is  not  always  less  than  or 

greater  than  the  bounds  LBl,  LB2.   This  can  be  seen  in  the  examples 

appearing  in  Rosberg  [17], 

Let  L  be  the  infimum  of  L  over  the  set  of  service  policies. 

Any  value  of  L  under  any  given  service  policy  can  be  used  as  an 

upper  bound  for  Lq.   We  shall  use  the  Service-Sharing  policy  for  that 
purpose,  since  in  practice  it  is  considered  a  good  policy  and  the 
loss  function  under  it  can  be  computed. 

From  lemma  3.4.1  it  follows  that  the  value  L  under  the  Service- 
Sharing  policy  is 

Z      c  (6)p  (B)/(l  -LP    (j))  A  UB  .  (3.30) 

.a    a         .  _   a     — 
aeA  jeB 

BeB 
Now,  from  (3.30)  we  have  the  following  theorem. 

THEOREM  3.4.4.  UB  >_  L   . 

Theorems  3.4.1-3.4.4  are  summarized  in  the  following  final 
corollary. 

COROLLARY  3.4.1. 


UB  1  Lq  2:  raax{LBl,LB2,LB3} 
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4.   DISCUSSION 

In  the  model  given  in  section  2.1  we  assumed  an  exponential 
distribution  of  the  service  requirements.   The  reason  behind  this 
assumption  is  technical  and  lies  in  the  fact  that  the  distribution 
of  the  remaining  service  time  of  each  customer  when  a  transition 
occurs  remains  the  same  as  at  the  moment  of  arrival.   This  is  essen- 
tial for  an  embedded  Markov  process  anal-"'si.s  of  the  underlying  process. 
These  remaining  time  distributions  cannot  be  handled  in  a  network  of 
queues  with  a  general  distribution  of  service  requirements,  since  no 
matter  what  embedded  Markov  process  we  consider,  there  will  always  be 
a  customer  at  an  arbitrary  point  of  his  service  duration  when  a  transi- 
tion occurs. 

However,  the  same  technique  as  in  section  3,  can  be  applied 
when  the  distributions  of  the  service  requirements  are  finite  mixtures 
of  gamma  distributions.   (In  which  the  state  space  takes  a  much  more 
complicated  form.) 

The  idea  and  technique  of  using  an  embedded  Markov  process 
analysis  with  this  generalization  of  the  service  requirements  can  be 
found  in  the  literature  (e.g.,  Baskett  [  2],  Kelly  [10]  and  Barbour  [1]) 
The  importance  of  this  extension  is  that  any  nonnegative 
distribution  can  be  approximated  as  closely  as  we  please  by  a  finite 
mixture  of  gamma  distributions. 

In  this  paper  we  considered  only  stationary  service  policies 
as  defined  in  section  2.1  (i).   An  important  problem  which  was  not 
considered  is  under  what  conditions  the  optimal  service  policy  (if 
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it  exists),  among  all  possible  service  policies,  is  a  stationary 
service  policy.   The  known  criteria  for  existence  of  an  optimal 
stationary  decision  rule  cannot  be  applied  to  the  problem  presented 
in  this  paper. 

A  question  which  should  be  answered  before  the  question 
above  concerns  the  conditions  for  ergodicity  of  the  class  of  Markov 
processes  n  ,  t^O,  under  any  sen/ice  policy.   Some  work  on  this  last 
problem  is  done  in  Rosberg  [16], 

Finally,  a  use  for  the  bounds  and  the  structure  of  L  ore- 
sented  in  this  paper,  is  given  in  a  separate  paper,  Rosberg  [17]. 
This  paper  presents  an  application  of  these  results  programmed  for 
interaction  computer  use. 
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